High-Performance Techniques for Parallel I/O
نویسندگان
چکیده
Wei-keng Liao Northwestern University 1.
منابع مشابه
Improving the Performance of the POSIX I/O Interface to PVFS
The ever-increasing gap in performance between CPU/memory technologies and the I/O subsystem (disks, I/O buses) in modern workstations has exacerbated the I/O bottlenecks inherent in applications that access large disk resident data sets. A simultaneous development in recent times has seen the maturity of Linux-based offthe-shelf clusters of PCs for low-cost, high-performance computing solution...
متن کاملI/O in Parallel Applications: the Weakest Link
Parallel computers are increasingly being used to run large-scale applications that also have huge I/O requirements. However, many applications obtain poor I/O performance on modern parallel machines. This special issue of IJSA contains papers that describe the I/O requirements and the techniques used to perform I/O in real parallel applications. We rst explain how the I/O application program i...
متن کاملChemIo: High Performance Parallel I/o for Computational Chemistry Applications
Recent developments in I/O systems on scalable parallel computers have sparked renewed interest in out-of-core methods for computational chemistry. These methods can improve execution time significantly relative to “direct” methods, which perform many redundant computations. However, the widespread use of such out-of-core methods requires efficient and portable implementations of often complex ...
متن کاملA Study of I/O Techniques for Parallel Visualization
This paper presents two parallel I/O methods for the visualization of time-varying volume data in a high-performance computing environment. We discuss the interplay between the parallel renderer, I/O strategy, and file system, and show the results of our study on the performance of the I/O strategies with and without MPI parallel I/O support. The targeted application is earthquake modeling usin...
متن کاملSpeeding up Automatic Parallel I/o Performance Optimization in Panda
The large number of system components and their complex interactions in a parallel I/O system, together with dynamically changing I/O patterns in scientiic applications, impose a great challenge in selecting optimal I/O plans for an anticipated I/O workload in a target execution environment. Previous research has shown that a model-based approach that uses a performance model of the parallel I/...
متن کاملHeuristics for Scheduling I/O Operations
The I/O bottleneck in parallel computer systems has recently begun receiving increasing interest. Most attention has focused on improving the performance of I/O devices using fairly low-level parallelism in techniques such as disk striping and interleaving. Widely applicable solutions, however, will require an integrated approach which addresses the problem at multiple system levels, including ...
متن کامل